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DECLARATION UNDER 37 C.F.R. §1.131 

I, Nimrod Megiddo, the inventor of the invention defined by claims 1-25 of U.S. Patent 
Application Serial No. 10/723,850 hereby declare the following: 

[0001] The purpose of this declaration is to prove that I conceived the claimed invention 
prior to the earliest effective prior art date of U.S. Patent Application Publication No. 
2005/0 100209A1 to Lewis et al. which is presently understood to be July 2, 2003. The following 
shows that I conceived my invention prior to July 2, 2003 and that I was diligent from my date of 
conception to its reduction to practice and was further diligent to the date of the filing of my 
patent application, which has a filing date of November 25, 2003 (hereinafter referred to as the 
"Patent Application"). I first disclosed the invention "A METHOD FOR AUTONOMIC 
OPTIMIZATION BY COMPUTER PROGRAMS" on a date before July 2, 2003, opened as 
Disclosure No. ARC820020057, which is dated before July 2, 2003. 
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[0002] I am the only inventor of the subject matter claimed in claims 1-25 of the Patent 
Application. 

[0003] During all time periods mentioned herein, and specifically between my 
conception date and the filing date of the Patent Application, all activities described herein 
occurred in the United States. 

[0004] Proof of the conception of the claimed invention prior to July 2, 2003, and 
diligence in reducing the invention to practice and filing the Patent Application is demonstrated 
in the attached Exhibit, labeled as Exhibit A. 

[0005] As shown in Exhibit A, which is an invention disclosure form typically used by 
the designated Assignee, International Business Machines Corporation, I conceived the claimed 
invention at a date prior to July 2, 2003. As permitted by MPEP §71 5.07, the dates on Exhibit A 
have been removed; however, I hereby declare that all dates corresponding to the conception 
date and reduction to practice occurred prior to July 2, 2003. Further, the invention was actually 
conceived before Exhibit A was prepared. Therefore, our conception date actually predates 
Exhibit A. 

[0006] Exhibit A specifically discloses the claimed invention as defined by the 
independent claims. For example, independent claim 1 recites, "A method of instructing a 
computer program to self-optimize, said method comprising: inputting a selection command that 
selects one function from a list of pre-selected functions for input into said computer program at 
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a point of choice determined by a programmer, wherein each function from said list of pre- 
selected functions is associated with a reward; and allowing a learning protocol in said computer 
program to track and reward said one function that is selected and to determine an approximate 
optimal choice of operation of said computer program based on said selection command." 

[0007] For example, independent claim 7 recites, "A method of optimizing a computer 
program, said method comprising: specifying at least one point of choice, determined by a 
programmer, in said computer program; defining a set of alternate choices at each point of 
choice, wherein said set of alternate choices include operational choices comprising: inputting a 
selection command that selects one function from a list of pre-selected functions for input into 
said computer program^ wherein each function from said list of pre-selected functions is 
associated with a reward; allowing a learning protocol in said computer program to track and 
reward said one function that is selected to determine an approximate optimal operation of said 
computer program based on said selection command; and setting at least one feedback point for 
said each point of choice. 

[0008] For example, independent claim 13 recites, "A program storage device readable 
by computer, tangibly embodying a program of instructions executable by said computer to 
perform a method of instructing a computer program to self-optimize, said method comprising: 
inputting a selection command that selects one function from a list of pre-selected functions for 
input into said computer program at a point of choice, determined by a programmer, wherein 
each function from said list of pre-selected functions is associated with a reward; and allowing a 
learning protocol in said computer program to track and reward said one function that is selected 
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and to determine an approximate optimal choice of operation of said computer program based on 
at least said selection command. 

[0009] For example, independent claim 19 recites, " A computer system comprising: a 
pre-complier that inputs a selection command at a point of choice, determined by a programmer, 
into a computer program that runs on a computer, said selection command selecting one function 
from a list of pre-selected functions for input into said computer program, wherein each function 
from said list of pre-selected functions is associated with a reward; and a processor adapted to 
execute a learning protocol in said computer program to track and reward said one function that 
is selected and determine an approximate optimal operation of said computer program based on 
at least said selection command. 

[0010] Exhibit A describes the above features. In fact, the descriptions provided in 
Exhibit A served as the basis for the specification, drawings, and claims of the Patent 
Application. The features provided in dependent claims 5-6, 8, 1 1-12, 17-18, and 23-24 are 
generally inferred in Exhibit A. 

[0011] I was diligent from the date of conception in reducing the invention to practice 
and in pursuing, preparing, and filing the Patent Application. 

[0012] I am informed and believe that on September 2, 2003, a patent attorney was 
instructed to prepare a patent application that eventually became the Patent Application, and the 
Patent Application was eventually prepared and filed on November 25, 2003. 
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[0013] The foregoing declarations are made according to my best recollection upon 
review of the appropriate documents and notes, and I hereby acknowledge that willful false 
statements and the like are punishable by fine or imprisonment, or both (18 USC §1001) and 
may jeopardize the validity of the application or any patent issuing thereon. All statements made 
herein are made of my own knowledge and are true and all statements that are made on 
information and belief are believed to be true. 




\ 




Nimrod Megiddo 



Date 
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*1 Ooerabilitv - is there an identifiable operable embodiment of the invention (i.e., an embodiment that 
has been demonstrated or that would be reasonably expected to provide the benefits of the invention)? 
• Yes O No 
Reasons for above answer 



*2 Novelty- Are one or more concepts) of the invention novel over what is already known in the 
literature, existing commercial products, patents, and earlier IBM invention disclosures? 

• Yes O No 

Reasons for above answer 
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*1 Adequacy of Description: 
6 Inadequate; invention unclear from description 
O Incomplete; essential features missing 
O Further clarification or implementation detail needed 
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*2. Technical contribution of invention: 
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O Major advance in technology 
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•7. How long is the invention likely to be used in products by IBM or others? 
O < 5 years 
O 5-10 years 
O 10-15 years 

• > 15 years 

Reasons for above answer 

*8, How easily can use of the invention by a third party be detected? 
6 Undiscoverable; third party must admit use for IBM to know 

• Difficult; e.g.; with reverse engineering or examination of available code 
O With work; e.g.; using test cases; but not reverse engineering 

O Easily; by running & viewing product operation 

O Trivially without purchase of product; e.g.; by reading product literature 
Reasons for the above answer, including description of how use could be detected: 
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entered), and the document will open for you to view. ^ 
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Comments by Nimrod Megiddo 
Comments by Nimrod Megiddo 
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I Introduction 

Software engineers often have various alternate ways of implementing algo- 
rithm* and they fix choices within the code bused on current belief* about, 
future environments. For example, an online scheduling algorithm picks 
f usks for execution, attempting to optimize the system according to some 
criterion but the code designer may not know what the best choices are in 
varioucs situations. Quite often., the code designer lacks the expertise that is 
reunited lor making the good choices. In many situations, the good choices 
depend on the environment and it is quite difficult to design m advance 
an algorithm the makes the best, choices with respect to any environment. 
On the other hand, there are known methods for adapting choices to an 
environment bv learning over time with feedback. 

Our purpose here is to formulate a framework in which a software en- 
gineer endows a software program with the ability to improve itself in the 
; e „se of making better choices with respect to the environment, m which 
it works The essence of the idea is to allow the designer just, to indicate 
the possibilities for adaptation and let a learning algorithm find the best 
choices whereevor the software designer thinks there is room for optimiza- 
tion One way to implement this idea is to have a pro-compiler extract the 
learning instructions ami generate aC program that includes all the. learning 

components. , , 

We first describe the pre-compiler commands and then explain how the 

homing is performed, 



2 The pre-compiler commands 

In this section we describe a set a possible pro-compiler command which 
support the specification if the learning tasks. 

2.1 The ! CHOOSE command 

The execution of computer is essentially deterministic, except that proba- 
bilistic computation can be implemented with pseudorandom number gen- 
erators. We propose here an extension to programming languages where the 
engineer leaves some choices open so that the program can later make good 
choices with respect to the environment in which it runs. 

A ! CHOOSE command can be included in the program for to be handled 
bv a pre-compiler as follows. It resembles the switch command in C, ex- 
cept that; the processor is free to choose (at execution time) anyone of the 
functions in the list between ICHOOSE command and IENDCHOOSE, ignoring 
the label and the parenthesized list of variables. The variables within the 
parentheses are used to encode a "state" winch is suggested to the proces- 
sor as a base for making the choice 1 . The idea is that the program would 
be able to learn over time the good choices with respect to the observable 
quantities. For example, 

ICHOOSE label 1 

(xl,x2,yl,z2) 
l:fl(); 
2:f2(); 
3: f3(); 

IENDCHGOSE 

Any one choice of a function should result in a valid execution of the 
program, but may cause the program to perform differently and may yield 
different results. The compiler is instructed either to build a program that 
learns from its experience or rather make arbitrary choices (i.e., choose the 
first function in each case). 

2.2 The ! RULES command 

Another pre-compiler feature is the capability of supplying specific rules of 
how to make a choice based on the state. This may be usetul when a pro- 
gram has already gamed some knowledge, and a small modification requires 

»Wc .Jisouss later tl»o decision rules. 



recompilatiom so the knowledge can be passed to t he revised program. One 
possible implementat ion of this feature is 

[RULES label 1 funcQ 

where labell is the label of the choice point and func(xl ,x2,x3) is a user- 
supplied function of the state variables of that decision point, which selects 
one the available choices. 

2.3 The ! REWARD command 

If a program is expected to optimize, it must be told what the goal is or at 
least be informed of rewards that are compatible with the goal The r eward 
mechanism may be implemented as follows. The command 

(REWARD label! fimclQ 

may be placed anywhere in the program. The call specifies which point of 
choice (e.g., labell) is rewarded, and which user-supplied function (fund) 
is to be used for calculating the reward. 



3 Generating optimizing program 

If the pre-compiler is instructed to generate an optimizing program, then 
it generates a C program that incorporates learning algorithms (e.g., Q- 
learning, TD-learning) for developing a good policy of making choices based 
on the current values of the state variables at each choice point. 

One possible way of learning is as follows. Suppose the state variables 
at a certain choice points are s u »™1 suppose a choice of function has 

vo be made from the indices l t ...,m. The state variables may themselves 
he functions of other program variables, as the desginer may wish. Denote 
the "value" a choice i (i - L, . • ■ ,m) at the state $ = <*i, - . . , s n ) 

n 

where the are supposed to be learned by the system. The linearity 
sumption is not too restrictive since the state variables themselves may be 
nmciions of other variables. The rewards associated with choice point are 
owl to update the current estimates of the coefficients «y that determine 
the V(i *)*. The best choice at s is an * which maximizes V{i..«). However, 



during the learning phase the system explores different values of i and uses 
known learning algorithms for approximating the true values of the V{i } s)s. 
The current «ys may be used for detremining the actual choice of the al- 
gorithm (with respect to the state) once the learning phase has ended, and 
the compiler generates a deterministic program. 



4 



